Must answer the questions below and attach H1 to submittals.
1. Does the candidate have minimum 4 to 5 years’ experience in the Hadoop platform? What is the most recent version of Hadoop they worked on?
2. Does the candidate have experience working with large and disparate data? If so, give examples.
3. So they have system integration experience in the Hadoop environment?
1. Design and development of data ingestion pipelines.
2. Perform data migration and conversion activities.
3. Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
4. Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments). 5. Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform. Required: 1. Java/J2EE 2. Web Applications, Tomcat (or any equivalent App server) , RESTful Services, JSON 3. Spring, Spring Boot, Struts, Design Patterns 4. Hadoop (Cloudera (CDH)) , HDFS, Hive, Impala, Spark, Oozie, HBase 5. SCALA 6. SQL 7. Linux
Must have a Bachelor’s degree in Computer Science or related IT discipline • Must have at least 5 years of IT development experience. • Must have strong, hands-on J2EE development • Must have in-depth knowledge of SCALA – Spark programming • Must have 3 years relevant professional experience working with Hadoop (HBase, Hive, MapReduce, Sqoop, Flume) Java, JavaScript, .Net, SQL, PERL, Python or equivalent scripting language • Must have experience with ETL tools • Must have experience integrating web services • Knowledge of standard software development methodologies such as Agile and Waterfall • Strong communication skills. • Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary Specific Knowledge, Skills and Abilities: • Ability to multitask with numerous projects and responsibilities • Experience working with JIRA and WIKI • Must have experience working in a fast-paced dynamic environment. • Must have strong analytical and problem solving skills. • Must have good verbal and written communication skills • Must be able and willing to participate as individual contributor as needed. • Must have ability to work the time necessary to complete projects and/or meet deadlines.